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Outline 


•  MTW  and  our  experience  base 

•  Three  phases  for  conducting  an  MTW 

•  How  MTWs  fit  into  system-of-systems  (SoS)  architecture  development 
and  analysis 
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Conceptual  Flow  of  the  MTW 


SoS  Drivers  and 
Capabilities 


SoS 

Architecture 

Plans 


Mission  Threads 
and  Vignettes 


SoS  Quality 
Attributes 


OV-1  ■ 

1 

OV-4  2 

Legacy  Systems 

OV-6C  ^ 

Challenges 


Quality  Attribute 
Augmentation 
and  Analysis 


Mission  Threads 
Augmented  with  Quality 
Attributes 

Architecture  Issues 
Engineering  Issues 


Capability  Issues 
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Mission  Thread  Workshops  -  Experiences 


Client 

Description 

MTWs 

Vignettes 

Mission 

Threads 

Stakeholders 

A 

IRAD  New 
Platform/Capability 

1 

1 

2 

8 

B 

New  Naval  Ship 

13 

17 

37 

>200 

C 

Battle  Command 

6 

3 

4 

>100 

D 

Maritime  Detection 

2 

4 

4 

30 

E 

NSF 

1 

3 

3 

15 

F 

Air  Force  Program 

1 

1 

1 

10 

G 

DHS 

2 

2 

3 

23 

H 

Other  Govt  Agency 

1 

4 

4 

12 

Identifies  SoS  architecture  gaps,  overiaps,  and  chaiienges 
Identifies  issues  for  constituent  legacy  systems  and  software  architectures 
Overcomes  organizationai  stovepipes  and  faciiitates  stakehoider 
communication 
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Three  Phases  of  an  MTW  Engagement 


A 

Up  to  6  weeks 


1-1.5  days 


Up  to  2  weeks 


MTW  Timeline 
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Preparation  Phase 


•  Review  the  MTW  process 

•  Develop  SoS  mission  and  business  drivers 

•  Develop  SoS  architecture  plans 

•  Develop  the  vignettes,  mission  threads,  and  appropriate  quality 
attributes 

•  Identify  participating  stakeholders 

•  Select  MTW  team 

•  Settle  on  logistics 
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SoS  Mission  and  Business  Drivers  and  Architecture  Pians 


Overview  presentation  of  the  SoS  mission  and  business 
drivers 

•  1-2  slides  on  the  business  drivers;  more  if  agreed  it’s  needed 

•  Identify  business/programmatic  context,  high-level  functional 
requirements,  high-level  constraints,  high-level  quality  attributes,  plan 
for  development,  and  the  program’s  goals  and  objectives 

Overview  presentation  of  the  SoS  architecture  plans 

•  1-2  slides  on  the  vision  for  the  architecture:  more  if  agreed  it’s  needed 

•  Identify  legacy  systems  being  considered,  high-level  constraints,  high- 
level  quality  attributes,  and  the  plan  for  development 

•  Visio/PowerPoint 

Need  to  establish  the  scope  of  the  mission  thread  analysis  effort 

•  70-80%  functionality 
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Vignettes 

A  vignette  has  two  parts: 

1 .  Vignette  description 

2.  Graphical  description  of  the  vignette,  such  as  an  DoD  OV-1  or  context 
diagram. 


Name  of  Vignette 

Protect  Fieet  Assets  Against  Cruise  Missiie 
Attacks 

Vignette  (summary 
description) 

Two  ships  (Alpha  and  Beta)  are  assigned  to  air  defense 
to  protect  a  fleet  containing  two  high-value  assets.  A 
surveillance  aircraft  and  four  UAVs  (two  pairs)  are 
assigned  to  the  fleet  and  controlled  by  the  ships.  A  pair  of 
UAVs  flying  as  a  constellation  can  provide  fire-control 
quality  tracks  directly  to  the  two  ships.  A  two-pronged 
attack  on  the  fleet  occurs: 

-  five  aircraft-launched  missiles  from  the  southeast 

-  three  minutes  later,  seven  submarine-launched 
missiles  from  the  southwest 

The  fleet  is  protected  with  no  battle  damage. 

Nodes/actors 

Alpha  and  Beta  ships,  two  high-value  assets, 
surveillance  aircraft,  UAVs,  missiles 

Assumptions 

Sea  state  is  Level  1 

Etc. 
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Ballistic  Missile  Defense  (BMD)  OV-1  Example 


^^BMC 


Gamma 


Carrier  Strike  Group 
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STRATCOM/ 


Surface  Action  Group 


THAAD 

COCOM/ 

JFACC 

JFMCC 

C2BMC 


Example  of  a  Context  Diagram  for  a  Wireless 
Emergency  Alerts  Message 


First  Responders 
Local  govt 


Emergency  Management 
Organization 


Citizen  calls  911 


saihAva  VVEUStriAve 

Pcbbifi  Colbmtu’ 

Trailside  ^rook  ,  Vista  Village 

Nottingtiam 


CMSP  Gateway 


j-  Lake  Arbor  . 
*■  Golf  Course 


Famiy  Chfistian 
Book  Store  \ 


Artof  Green 
Townltomes 


'S' 

^^201 3  Google 


Park 


Mountain 
Vista  Village 


iLatfe  Arbor 

'  data  ©2013  Google 


Message 
Recipient 
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Mission  Thread  Snippet 


Step 

Description 

Engineering  Considerations, 

Issues,  Challenges 

1 

A  large  truck  carrying  pesticide  goes  through  an  intersection 
with  a  "RED"  traffic  light  and  is  hit  broadside  by  an  SUV.  Both 

vehicles  burst  into  flames. 

1. 

2 

Several  citizens  in  cars  that  were  approaching  the 
intersection  stop  and  call  911  to  report  the  accident.  Others 
rush  to  assist  the  accident  victims. 

1.  911  call  center  starts  receiving 
calls  but  Is  quickly 
overwhelmed  with  the  volume 

2.  Calls  start  rolling  to 
neighboring  911  call  centers 

3.  Begin  Initial  assessment 

3 

Driver  from  SUV  Is  pulled  from  vehicle  and  placed  on  a 
nearby  lawn. 

1.  Fire,  police,  EMS  are 
dispatched  to  accident 

2.  No  Information  provided  to 
public  yet.  (should  any  be?) 

3.  Asmoke  plume  begins  drifting 

toward  residential  area. 
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Quality  Attributes 


Quality  Attribute 


Performance 

Security 

Usability 

Resilience 
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Wrap-up  of  Preparation  Steps 


Identify  participating  stakeholders 

•  Need  to  elicit  architectural  and  engineering  considerations  for  the  mission 
threads 

•  Experience  of  stakeholders  largely  determines  quality  of  the  results 


Select  MTW  team 

•  Consists  of  three  or  more  people  who  fill  the  four  MTW  roles  (lead,  facilitator, 
scribe,  and  analyst) 

•  Experienced  architects  with  good  facilitation  skills  and  related  quality  attribute 
knowledge 


Logistics  of  the  MTW 
•  Room,  equipment 
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Conduct  Workshop  Phase 


•  Present  the  MTW 

•  Present  the  business  and  mission  drivers 

•  Present  the  architectural  plan 

•  Review  the  vignette 

•  Augment  the  mission  thread 

•  Consider  extensions  to  the  mission  thread 

•  Discuss  overarching  quality  attribute  considerations 

•  Analyze  remaining  mission  threads 
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MTW  Agenda 


Day  1 :  XX  XXX  2009 


08:00- 

08:15- 

08:30- 

08:45- 

09:00- 

09:30- 

09:45- 

12:00- 

13:00- 


-08:15 

-08:30 

-08:45 

-09:00 

-09:30 

-09:45 

-12:00 

-13:00 

-17:00 


Welcome/Introductions/Opening  Remarks  (name,  SEI) 
MTW  Overview  (SEI) 

Business  Drivers  and  Quality  Attributes  (name) 
Architecture  Plan  (name) 

Vignettes  and  OV-1  Descriptions  (name) 

Break 

Augmentation  of  Mission  Threads  (SEI  facilitated) 
Lunch 

Augmentation  of  Mission  Threads  (SEI  facilitated) 


Day  2:  XX  XXX  2009 

08:00-12:00  Augmentation  of  Mission  Threads  (SEI  facilitated) 

12:00-13:00  Lunch 

13:00-16:30  Augmentation  of  Mission  Threads  (SEI  facilitated) 

16:30-17:00  Summary/Wrap  Up 
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Follow-On  Phase 


•  Scrub  the  augmented  mission  threads 

•  Reference  each  comment  with  a  unique  identifier 

•  Produce  a  group  of  challenges 

•  Develop  a  briefing  to  summarize  the  challenges 

•  Complete  the  Mission  Thread  Description  Document 
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Augmented  Mission  Thread 


Step  Description 


Driver  from  SUV  is  pulled  from  vehicle  and  placed  on  a 
nearby  lawn. 


Engineering  Considerations, 
Issues,  Challenges 


A  large  truck  carrying  pesticide  goes  through  an  intersection 
with  a  "RED"  traffic  light  and  is  hit  broadside  by  an  SUV.  Both 
vehicles  burst  into  flames. 


Several  citizens  in  cars  that  were  approaching  the 
intersection  stop  and  call  911  to  report  the  accident.  Others 
rush  to  assist  the  accident  victims. 


1.  911  call  center  starts  receiving 
calls  but  is  quickly  over¬ 
whelmed  with  the  volume 

2.  Calls  start  rolling  to 
neighboring  911  call  centers 

3.  Begin  initial  assessment 


1.  Fire,  police,  EMS  are 
dispatched  to  accident 

2.  No  information  provided  to 
public  yet.  (should  any  be?) 

3.  A  smoke  plume  begins  drifting 
toward  residential  area 


Software  Engineering  Institute 


Carnegie  Mellon 


MTW:  Preparation  and  Execution 
Tim  Morrow,  May  2,  2013 

©2013  Carnegie  Mellon  University 


Scrubbed,  Augmented  Mission  Thread 


step 

Description 

Engineering  Considerations, 
Issues,  Challenges 

1 

A  large  truck  carrying  pesticide  goes  through  an  intersection 
with  a  "RED"  traffic  light  and  is  hit  broadside  by  an  SUV.  Both 
vehicles  burst  into  flames. 

MTl-1-1. 

2 

Several  citizens  in  cars  that  were  approaching  the 
intersection  stop  and  call  911  to  report  the  accident.  Others 
rush  to  assist  the  accident  victims. 

MTl-2-1.  911  call  center  starts 
receiving  calls  but  is  quickly 
overwhelmed  with  the  volume 
MTl-2-2.  Calls  start  rolling  to 
neighboring  911  call  centers 
MTl-2-3.  Begin  initial 
assessment 

3 

Driver  from  SUV  is  pulled  from  vehicle  and  placed  on  a 
nearby  lawn. 

MTl-3-1.  Fire,  police,  EMS  are 
dispatched  to  accident 

MTl-3-2.  No  information 
provided  to  public  yet 

MTl-3-3.  A  smoke  plume  begins 
drifting  toward  residential  are. 
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Challenge  Area  Grouping 


Initial  Grouping 


Category 

Mission  Thread  Reference 

Alert  severity  levels 

Assumptions,  MT5-10-5 

911  call  center  overload 

MT2-4-1,  MT2-4-2,  MT4-4-3,  MT4-5-4,  MT5-9-1,  MT5-9-2,  MT5-9-14,  MT5-10-6,  MT5-10-10 

Public  education  -  alert  awareness 

MT3-4-5,  MT4-9-2,  MT4-9-16,  MT5-11-2,  MT5-11-6,  MT5-11-11 

Role  of  a  communications  manager 

MT1-4-7,  MT1-9-2,  MT1-9-7,  MT1-9-8,  MT2-10-6,  MT2-11-6,  MT2-11-11 

Tool  features 

MT3-4-9,  MT5-1-5,  MT5-1-11 

Coordination  and  jurisdiction 

MT2-4-11,  MT2-5-1,  MT4-6-2,  MT4-9-5,  MT4-11-1 

Future  information  inputs 

MT3-5-3,  MT3-9-6,  MT3-9-13,  MT3-9-16 

Operator  training 

MT2-9-3,  MT2-9-6,  MT2-9-16,  MT2-10-6 

Mutual  aid  agreements/awareness 

MT1-5-4,  MT1-9-5,  MT1-9-6,  MT1-9-8,  MT4-6-3,  MT4-6-4 

Operators’  procedures 

MT2-4-2,  MT2-6-2,  MT3-9-1,  MT3-9-16,  MT4-4-6,  MT4-4-10 

Scenario  planning 

MT1-9-1,  MT1-9-9,  MT1-9-10,  MT3-3-2,  MT3-3-9,  MT3-3-11 

Public’s  expectations 

MT1-4-12,  MT1-9-2,  MT1-9-16,  MT1-11-2,  MT1-11-6 

When  to  send  an  alert 

MT1-4-3,  MT2-6-2,  MT2-6-3,  MT2-6-4,  MT3-9-7,  MT4-2-4,  MT4-3-5 

Communication  channels 

MT1-4-1,  MT1-4-10,  MT3-5-3,  MT3-6-2,  MT4-9-1,  MT4-9-2,  MT5-3-6 

Security 

Sec-2,  Sec-4,  Sec-5 

Chailenge  Areas 


Category 

Mission  Thread  Reference 

Alert  severity  levels/When  to  send  an  alert 

Assumptions,  MT5-10-5,  MT1-4-3,  MT2-6-2,  MT2-6-3,  MT2-6-4,  MT3-9-7,  MT4-2-4,  MT4-3-5 

Tool  features/Future  information  inputs 

MT3-4-9,  MT5-1-5,  MT5-1-11,  MT3-5-3,  MT3-9-6,  MT3-9-13,  MT3-9-16 

Coordination  and  jurisdiction/Mutual  aid  agreements/Awareness 

MT2-4-11,  MT2-5-1,  MT4-6-2,  MT4-9-5,  MT4-11-1,  MT1-5-4,  MT1-9-5,  MT1-9-6,  MT1-9-8,  MT4-6-3,  MT4-6- 
4 

Operators’  procedures/Operator  training 

MT2-4-2,  MT2-6-2,  MT3-9-1,  MT3-9-16,  MT4-4-6,  MT4-4-10,  MT2-9-3,  MT2-9-6,  MT2-9-16,  MT2-10-6 

Scenario  planning/911  call  center  overload 

MT1-9-1,  MT1-9-9,  MT1-9-10,  MT3-3-2,  MT3-3-9,  MT3-3-11,  MT2-4-1,  MT2-4-2,  MT4-4-3,  MT4-5-4,  MT5-9- 
1,  MT5-9-2,  MT5-9-14,  MT5-10-6,  MT5-10-10 

Public’s  expectations/Public  education  -  alert  awareness/Role  of  a 
communications  manager 

MT1-4-12,  MT1-9-2,  MT1-9-16,  MT1-11-2,  MT1-11-6,  MT3-4-5,  MT4-9-2,  MT4-9-16,  MT5-11-2,  MT5-11-6, 
MT5-11-11,  MT1-4-7,  MT1-9-2,  MT1-9-7,  MT1-9-8,  MT2-10-6,  MT2-11-6,  MT2-11-11 

Communication  channels 

MT1-4-1,  MT1-4-10,  MT3-5-3,  MT3-6-2,  MT4-9-1,  MT4-9-2,  MT5-3-6 

Security 

Sec-2,  Sec-4,  Sec-5 
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Example  of  a  Challenge 


Challenge:  What  civil  emergencies  are  worthy  of  a  WEA  message? 

Category  grouping:  Operational  procedures,  governance 
Supporting  info 
.  MT5-10-5 

.  MT2-6-2,  MT2-6-3,  MT2-6-4 
.  MT4-3-5 


Recommendations 

•  Continue  to  identify  and  develop  civil  emergency  scenarios  that  can  be 
discussed  with  first  responders  and  partnering  communities  to  develop  a 
consistent  approach  for  determining  when  to  issue  WEA  messages. 

•  Continue  to  host  meetings  with  NWS,  FEMA,  DHS,  and  the  state  to  share 
information  about  when  it  is  appropriate  to  send  a  WEA  message. 
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Contents  of  the  Mission  Thread  Description  Document 


Inputs 

•  Presentations 

-  MTW  process 

-  Business  and  architecture  drivers  and  plans 

•  Tailored  vignette(s)  and  mission  threads 

Outputs 

•  Mission  threads  augmented  with  quality  attributes 

•  Analysis  methods 

•  Challenges 
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How  MTWs  Fit  into  SoS  Architecture 
Development  and  Analysis 


Vignettes 
Mission  Threads 
SoS  Architecture  Plans 


Mission  Thread 
Workshops 


Mission  Threads  Augmented 
with  Quality  Attributes 
SoS  Architecture  Challenges 


SoS  Mission  and 
Business  Drivers 
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Overview 


Architecture 
Challenge 
Workshops  and 
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Overview 


SoS  Architecture 


Business  Drivers 
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SoS  Architecture  Quality  Attribute  Specification  and  Evaluation 
Approach 

•  Early  elicitation  of  quality  attribute  considerations 

•  Early  identification  and  addressing  of  architecture  challenges 

•  Early  identification  and  mitigation  of  architectural  risks 
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Contact  Information 


Tim  Morrow 

Senior  Member  of  the  Technical 
Staff 

Software  Solutions  Division 
Email:  tbm@sei.cmu.edu 

Web 

WWW.  se  i .  cm  u .  ed  u/a  rch  i  tectu  re 
WWW.  se  i .  cm  u .  ed  u/co  n  tact .  cf  m 


Software  Engineering  Institute 


U.S.  Mail 

Software  Engineering  Institute 
Customer  Relations 
4500  Fifth  Avenue 
Pittsburgh,  PA  15213-2612 
USA 

Customer  Relations 

Email:  info@sei.cmu.edu 

Telephone:  +1  412-268-5800 

SEI  Phone:  +1  412-268-5800 

SEI  Fax:  +1  412-268-6257 
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